Weight-driven growing networks 
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We study growing networks in which each link carries a certain weight (randomly assigned at birth 
and fixed thereafter) . The weight of a node is defined as the sum of the weights of the links attached 
to the node, and the network grows via the simplest weight-driven rule: A newly-added node is 
connected to an already existing node with the probability which is proportional to the weight of 
that node. We show that the node weight distribution n(w) has a universal, that is independent 
on the link weight distribution, tail: n(w) ~ w~ 3 as w — > oo. Results are particularly neat for the 
exponential link weight distribution when n(w) is algebraic over the entire weight range. 

PACS numbers: 02.50.Cw, 05.40.-a, 05.50.+q, 87.18.Sn 



I. INTRODUCTION 

The network structure lies beneath many physical, bio- 
logical, social, economical, and other real-world systems. 
Examples include resister networks, metabolic networks, 
communication networks like the Internet, information 
networks like the world-wide web, transportation net- 
works, food webs, etc. Some networks are engineered 
while others like the world-wide web are created in a 
chaotic manner, viz. by the uncoordinated actions of 
many individuals, and yet they show a great deal of self- 
organization [lj . This surprising order of seemingly dis- 
ordered networks was noticed long ago in the context of 
random graphs Q,0|, and it is also apparent in the models 
of growing random networks that have been thoroughly 
studied in the past few years (see reviews 0, 0, Q and 
references therein). 

Networks or graphs are defined as sets of nodes joined 
by links. A link in a graph merely indicates that a given 
pair of nodes is connected. If however connections dif- 
fer in "strength" , one may formalize this property by 
assigning a weight to each link. Many real-world net- 
works are intrinsically weighted. In a collaboration net- 
work, the weight of a link between co-authors measures 
the strength of the collaboration such as the number of 
jointly-authored publications 0,0- I n the airline trans- 
portation network, the weight of a link between two air- 
ports gives the passenger capacity on this route 0, El • 
Thus mathematically the weighted network is a graph in 
which each link carries a certain number which is called 
the weight. Weighted networks appear in literature un- 
der different names. For instance, the multigraph — that 
is the graph in which two nodes can be joined by mul- 
tiple links — can be replaced by the graph in which a 
link between two nodes carries the integer weight equal 
to the number of links in the original multigraph joining 
those two nodes. Numerous engineering and mathemat- 
ical studies of the flows in networks also treat weighted 



networks — the weight (usually termed "capacity" ) rep- 
resents the maximum allowed flow • Resistors net- 
works (see e.g. ^10>E|) form another very important 
class of weighted networks. 

The models of weighted networks are usually close to 
the unweighted ones as far as the underlying graph struc- 
ture is concerned. In other words, the link weights are 
passive variables. This allows to study weighted networks 
using the knowledge of unweighted networks as the start- 
ing point 0, I n reality, the link weights can of 
course affect the graph structure. The range of possi- 
ble models in which the link weig hts are active variables 
is extremely broad (see e.g. Hi |H E3, El E2 ) while 
the mechanisms driving the evolution of the real-world 
networks are still hardly known. In such situation one 
wants to study a minimal rather than detailed models. 
Here we introduce and investigate a minimal model of 
the weight-driven growth. 

In Sec. [HI we introduce the minimal model precisely, 
and determine the node weight distribution and the joint 
node weight-degree distribution. We then compute the 
in-component weight distribution. In Scc. lIIII we discuss 
some generalizations of the minimal model. We conclude 
in Sec. HVI 
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II. THE MODEL 

The model is defined as follows. Each link carries a 
positive weight w which is drawn from a certain distribu- 
tion p(w). We shall assume that the weights are positive 
p3|. The weight is assigned to the link when the link is 
created, and it remains fixed thereafter. The weight of a 
node is the sum of the weights of the links attached to 
the node. When a new node is added, it is linked to a 
single "target" node with probability proportional to the 
weight of the target node. 

We assume that only one link emanates from each 
newly-introduced node, so the resulting network is a tree; 
the general case when a few links emanate from each 
node is discussed in Sec. IIIII The weight of a node (also 
termed as the node strength by some authors) increases 
when a new link is attached to it, yet, as the size of the 
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network grows, the node weight distribution approaches 
a stationary distribution. Our first goal is to determine 
this distribution. 



A. Weight Distribution 

Let N be the total number of nodes in the network and 
N w (JV) dw the number of nodes whose weight lies in the 
range (w, w + dw). When N is large, it can be treated as 
a continuous variable, and N W {N) satisfies 



dN w 
dN 



1 

W 



dx p(w — x) x N x — w N u 



+pH , (l) 



where W(N) = J Q dw w N w (JV) is the total weight of all 
nodes |2J| . The term in Eq. (JJJ which is proportional to 
xN x /W accounts for nodes with weight x which gain a 
link of weight w — x thereby creating nodes of weight w. 
The term wN w /W is the corresponding loss term. The 
last term accounts for the newly introduced node which 
has the same weight as its link. 

N W (N) — Nn(w) for large N, i.e. the weight distribu- 
tion approaches a stationary (JV independent) distribu- 
tion n(w). Hence, Eq. |QJ simplifies to 



(A + w) n(w) = / dx p(w — x) x n(x) + A p(w) , (2) 
Jo 

where A = J^°dwwn(w) is the average node weight. 
The total weight of all nodes is twice the total weight 
of all links (since each link connects two nodes) and the 
same obviously holds for the average weights. Therefore 

/>oo 

A = 2(w) — 2 / dww p{w) . 
Jo 

We now specialize Eqs. to the uniform link weight 
distribution 



p{w) 




(3) 



Using relation A = 2(w) — 1 and the shorthand notation 
F(w) = 1 + J™ dxx n(x) we recast into 



(1 + w) n(w) 



F(w) vi < 1 

F(w)-F(w-l) w>l 



(4) 



One can solve (gj) recursively. Using F'(w) = wn(w) 
we find that for w < 1 the cumulative distribution satis- 
fies [w- 1 + 1] F'(w) = F(w) (here F' = dF/dw). Solving 
this equation subject to the boundary condition F(0) = 1 



yields F(w) = (1 
bution is 



e w . Therefore the weight distri- 



On the next interval 1 < w < 2, we ought to solve 

( w - 1 + l)^ = F-w- 1 e w - 1 . 
dw 

The solution should match the previous one; this gives 
the boundary condition F(l) = e/2. The resulting cu- 
mulative distribution is F = e" 1-1 (e + 1 — w)/(l + w), 
from which we obtain the node weight distribution 



n(w) 



e + 1 — w 1 



1 + w \ 1 + w 



for 1 < w < 2 



Interestingly, the weight distribution loses continuity at 
the cutoff value w = 1 of the uniform link weight dis- 
tribution: n(l - 0) = e/4 while n(l + 0) = (e - 2)/4. 
Proceeding, one finds the node weight distribution on 
the interval 2 < w < 3, etc. The distribution is an- 
alytic everywhere apart from the integer values; at the 
integer value w = k > 2, the node weight distribution is 
continuously differentiable k — 2 times (see Fig.^). The 
analytic expressions for the node weight distribution are 
very cumbersome for large w. Fortunately, the asymp- 
totic behavior in the tail region is very simple. To extract 
the asymptotic we expand the right-hand side of J3J using 
the Taylor series: 

F(w)-F(w-1) = F'{w)- -F"(w) + ... 

= wn(w) — — [wn(w)]' + . . . . 

Plugging this expansion into Q we obtain 
dn 

w — h 3 n = , 

dw 



(5) 



which is solved to give 

I ^ A 
n(w) — > 

w 6 



when 



oo 



(6) 



The amplitude A cannot be found by solving the linear 
equation JSJ; its determination requires analysis of the 
full problem (gj. 

Note also that for the deterministic link weight distri- 
bution p(w) = 5(w — 1) the weight of the node is equal to 
the degree, so the model becomes equivalent to the ba- 
sic growing network model with preferential attachment 
that also leads to a node weight distribution with w~ 3 
tail. In general, the large weight tail of the node weight 
distribution is always given by Eq. © if the link weight 
distribution has a cutoff. To prove this assertion suppose 
that p(w) — for w > 1. For w > 1, Eq. (J2J) becomes 



(A + w) n(w) = $(w) 



(7) 



with $(w) = Jq 1 dx p(x) (w — x) n(w — x)\ for the uniform 
distribution $(w) = F(w) — F(w — 1) and Eq. Q turns 
into Eq. J3J. Expanding the integrand in $(iy) 



n(w) = (l + W y 2 e v 



for w < 1 . 



(w — x) n(w — x) — w n(w) — x [wn(w)] + 



(8) 
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FIG. 1: The node weight distribution n(w) emerging for uni- 
form and exponential link weight distributions. 



yields 



$>(w) = wn(w) — — [wn(w)]' + . . . , 



(9) 



where relations J dw p{w) = 1 and J dwwp(w) = A/2 
were used. In conjunction with ySf. Eq. (JJJ reduces to 
Eq. (J5J leading to the tail given by ||BJ. This derivation, 
as well as the earlier one that led to Eq. (JSJ, ignores the 
higher terms in the expansion JSJ. Keeping such terms 
one would obtain 



w — h 3 n — k 2 [wn(w)]" 

dw 3 



«3 [wn(w)}' 



(10) 



with k 2 = A -1 J dw w 2 p(w), k 3 = A -1 J dw w 3 p(w), etc. 
Solving 1(10(1 gives higher order corrections to the tail 
asymptotics 
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but it does not affect the leading w 3 tail. 
The exponential link weight distribution 

p{w) = e- w 



(11) 



(12) 



is particularly appealing as the node weight distribution 
in this case is remarkably simple. The governing equa- 
tions become 



(2 + w) e w n(w) = / dx x e x n(x) + 2 



(13) 



Writing G(w) = 2 + J Q dx x e x n(x) we recast integral 
equation 113(1 into a simple differential equation 



to / aw 



We find G{w) = 8{w + 2)~ 
n(w) — 



from which 



(14) 



(15) 



Thus for the exponential link weight distribution, the 
emerging node weight distribution is scale-free (that is, 
purely algebraic) over the entire weight range. 

We now outline the behavior for link distributions with 
heavy tails. Consider particularly distributions with a 
power-law tail p{w) ~ w~ L '; the exponent must obey the 
inequality v > 1 to ensure normalization J dw p(w) = 1 . 
It is easy to check that for v > 3 the leading asymptotic 
of the node weight distribution is n(w) ~ w~ 3 ; moreover, 
expansion l|ll|) holds up to the order of n, where n is the 
largest integer smaller than v (i.e. n < v < n+ 1) p^j . 
For 2 < < 3 the leading term shows even slower decay 
n(w) r~j (3 — v)~ 1 w~ lJ . 

The situation is very different for 1 < v < 2 when 
the total weight grows with size faster than linearly: 
W - iV 1 /^ -1 ). Using the usual definition N w = Nn(w), 
we observe that the square bracket term in Eq. is 
negligible for large N values. Hence n(w) —> p(w), sug- 
gesting that the number of nodes with more than one 
links grows slower than linearly in N, that is only the 
dangling nodes give contribution to n(w). 



B. Weight-Degree Distribution 

The node weight distribution is perhaps the most nat- 
ural, and therefore readily tractable, local characteristic 
for networks with weight-driven growth. Of course, the 
degree distribution remains geometrically the simplest lo- 
cal characteristic, yet for the weighted networks it is gen- 
erally impossible to write down a closed equation for the 
degree distribution nfe. To compute nk, one must de- 
termine the joint weight-degree distribution nk(w); the 
degree distribution is then found by integration 



dw nk{w) 



(16) 



The weight-degree distribution obeys a set of equations 
similar to . The density of dangling nodes is given by 



(X + w)n 1 (w) = Xp(w) (17) 
while for k > 2 the weight-degree distribution satisfies 

i> w 

(X + w)nk{w)— / dx p(w — x) x rik-i(x) . (18) 
Jo 

One can treat Eqs. l|17 fl -H18 |) recursively, yet even for the 
simplest link weight distributions like the uniform distri- 
bution © the exact expressions for ii}~(w) become very 
unwieldy as the degree grows. Exceptionally neat results 
emerge again for the exponential link weight distribution 
(|12p. In this case 



(2 + w) e w n k {w) 



dx e x x nk-i(x) 



(19) 
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Starting with n\(w) — e~ w we explicitly computed a 
few more n k (w) which led us to the hypothetical solution 
(we use the shorthand notation fl = w — 2 In (l + ^)) 



n k (w) 



1 



n 



fc-i e -n 



(l + f) 3 (fc-1)! 



(20) 



(Of course, the above ansatz agrees with the sum rule 
n(w) — J2k>i nk ( w )-) H avm g guessed the solution, it 
is then straightforward to verify its validity. Note that 
asymptotically (k ^S> 1), the joint weight-degree distribu- 
tion approaches a Gaussian centered around il = fc — 4, or 
Wk ~ k + 2 In k, with width oc \fk. Interestingly, the av- 
erage weight of the nodes of degree k, viz. w k w k + 2 lnfc, 
slightly exceeds [2(| the expected value w k — k. 

The degree distribution does not admit a simple closed 
form even for the exponential link weight distribution. 
The exact expression 



(19. 



k-l 



f(l + f) 2 (fc-1)! 



(21) 



simplifies for k 3> 1. Indeed, utilizing two properties of 
the quantity Sl k e Jk\ , viz. (i) it has a sharp maximum 
at SI = k and (ii) L dSl Sl k e~°/fc! = 1, we estimate the 
integral in 121fl as the value of the slowly varying part of 
the integrand (-f ) _1 (1 + -f) -2 near the maximum, i.e. at 



fc + 21nfc. Thus 



A- 3 



48 



In k 
~k^ 



+ o{k- A ) 



(22) 



C. In-Component Weight Distribution 

The emerging network has the natural structure of the 
directed graph since each new link starts at the new node 
and ends up at some previous node. Taking into ac- 
count the orientation of each link allows to define an in- 
component and an out-component with respect to each 
node. For instance, the in-component of node x is the 
set of all nodes from which node x can be reached follow- 
ing a path of directed links (Fig. |5J ■ The computation 
of in- and out-component size distributions is quite com- 
plicated as one must first determine joint distributions 
that involve both size and weight. In contrast, in- and 
out-component weight distributions can be determined 
directly. Here we compute the in-component weight dis- 
tribution. 

Let wo be the weight of the link emanating from node 
x and w the total weight of all other links in the in- 
component of node x; then the total weight of that in- 
component, that is the sum of weights of all nodes in 
in-component of node x, is wo + 2w. Denote by i(wo, w) 
the density of such in-componcnts. Here we tacitly as- 
sume that w > 0, that is the size of the in-components 
is larger than one. The density i(wo) of in-components 
of size one and weight wq is found by noting that such 




-component^ in-component \ 

) 



FIG. 2: In and out components of node x. In this example, 
the out-component has size 3 and the in-component has size 
5 (node x itself belongs to its in and out components) . 



in-components are just dangling nodes, so 

A 



i{w 



ni(w ) 



X + Wq 



(23) 



The density i(wo, w) satisfies 

Xi(wo,w) = / dx p(w — x) (wq + 2x) i{wa, x) 
Jo 

- (w + 2w) i(w , w) + i(w ) w p(w) . 

For the exponential link weight distribution (|12[) . this 
equation can be re-written in a simple form 



ow 



v wo + 2w 

where G — G(wq, w) is the auxiliary variable 



G = 



dx e x (wq + 2x) i(wo,x) + 



2 wo _ t 



w 



(24) 



(25) 



Solving |21 we obtain G(w , w) = G(w , 0) 2 *£+ 2w e w . 
Equation Ij25(l gives the initial condition, so the auxiliary 



2 tup 



variable reads G — , 
the in-component density 



e w - w °. This result leads to 



z(w , w) = 



2 w 



(2 + w + 2w) 2 



(26) 



Now the total weight of the in-component is s = wq + 2w, 
and the respective weight distribution I(s) is 



1 r 

I(s) = i(s) + - J dw i[w , {s ~ w )/2] 
Plugging ll'MI) and (|26|l into l|27|l we arrive at 



1(8) 



2 + s (2 + s) 2 



(27) 



(28) 



Therefore up to an exponentially small correction, the in- 
component weight distribution is algebraic with exponent 
2 (the same exponent characterizes the in-component size 
distribution |27| . which is not so surprising as this expo- 
nent is found to be very robust). 
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III. GENERALIZATIONS 

The model of the previous section always results in a 
tree structure by construction. In this section we con- 
sider two generalizations of that model which allows the 
formation of loops in the evolving network. 

The simplest generalization of the minimal model lead- 
ing to a network with many loops is to connect a newly 
created node to m target nodes. The attachment prob- 
ability is still proportional to the weight of the target 
node as before, and the weights of the m new links are 
chosen independently from the link weight distribution 
p{w). The weight of the newly introduced node becomes 
the sum of the m independent link weights, which is then 
distributed according to p m (w), the m-fold convolution 
of p(w). The governing equation thus remains similar to 
Eq. Q except that the last term p(w) becomes p m (w), 
and the square bracketed term gains a factor m due to 
the to attached links. As the average node weight is also 
to times larger than previously, that is A = 2m (w) , and 
the node density satisfies equation 

(2(w) + w) n(w) — / dx p(w — x) xn(x) + 2(w)p m (w) 
Jo 

which is almost identical to Eq. (J2J , the only difference is 
the second term on the right-hand side which now con- 
tains p m (w) instead of p{w). The modified model leads 
to the same ~ w~ 3 tail for the node weight distribution 
for any p(w) with a cutoff since then p m {w) also has a 
cutoff and the same argument applies as before. For the 
exponential link weight distribution p(w) = e~ w the con- 



voluted distribution is p m (w) = e 



/(to — 1)!, and 



the resulting node weight distribution is algebraic (up to 
an exponentially small correction) 



n(w) 



2m{m + 3) 
{2 + wf 



for 



A more substantial generalization of the minimal 
model is to allow the creation of links between already 
existing nodes [28| . We again choose the simplest weight- 
driven rule, namely we assume that a new link is created 
with rate proportional to the product of weights of the 
originating and target nodes. Let r be the average num- 
ber of link creations between already existing nodes per 
node creation, so in the network with N nodes the aver- 
age number of links is (1 + r) N. This can be modeled by 
two independent processes: with probability 1/(1 + r), 
a new node is attached to the network, and with proba- 
bility r/(l + r) a new link is added between two already 
existing nodes. The weight distribution N W (N) satisfies 
an equation similar to (I}, with the term in the square 
brackets multiplied by (1 + 2r)/W . The governing equa- 
tion for the normalized weight distribution n(w) is there- 
fore almost identical to Eq. (|2J), the only change is the 
replacement A^A = A/(1 + 2r): 



(A + w) n(w) 



The average node weight A = / °° dw w n(w) is now equal 
to 2(1 + r)(w) since the number of links now 1 + r times 
exceeds the number of nodes and each link contributes 
twice. Multiplying l|29ll by w and integrating over w we 
indeed obtain A = 2(1 + r) J °° dw w p(w) thereby provid- 
ing a useful check of self-consistency. 

For the exponential link weight distribution (|12fl the 
node weight distribution satisfies 



l + 2r A w , , , l + 2r . , 
1 + 7T W ) e n \ w ) = 1 + o 7T I dxxe n(x) 



2 + 2r 



2 + 2r 



Solving this equation we again obtain the purely alge- 
braic node weight distribution: 



/ , 1 + 2r 



3 + 4r 
l + 2r 



The exponent v monotonously decreases from 3 to 2 as 
r increases from to oo. 



IV. CONCLUSIONS 

We examined a minimal model for the weight-driven 
network growth. The virtue of the minimal model is that 
its many features like the node weight distribution, the 
joint node weight-degree distribution, the in-component 
weight distribution, etc. are tractable analytically. In 
particular, we showed that the node weight distribution 



exhibits a universal 



,-3 



tail independently on the link 



dx p(w — x) x n(x) + A p(w) . (29) 



weight distribution (as long as the tail of the latter is 
sharper than w~ 3 ), and the in-component weight distri- 
bution displays a robust s~ 2 tail. 

Remarkably simple behaviors characterize the expo- 
nential link weight distribution: The emerging node 
weight distribution is purely algebraic, the joint node 
weight-degree distribution and the in-component weight 
distribution are also given by neat closed formulas. 

We also studied generalizations of the minimal model 
for the weight-driven network growth. When a new node 
is connected to several target nodes and/or links are ad- 
ditionally created between already existing nodes, the 
network acquires loops yet it remains tractable. One 
generic feature of this class of models is that the node 
weight distribution remains algebraic, n(w) ~ w~ v , with 
the exponent v varying from 3 to 2 as the average node 
degree increases from one to oo. 
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